Simulating two way connectivity for one way data streams for multiple parties

ABSTRACT

A host device is disclosed. The host device includes a processor and a control mechanism. The processor operates to receive primary and associated data, the associated data being targeted for different recipients, decode and separate the associated data from the primary data, and cause the associated data to be correspondingly rendered on separate hand held devices. The processor also operates the control mechanism to control a separate display apparatus to separately receive and render the primary data.

RELATED APPLICATIONS

The present application is a continuation-in-part application to U.S.patent application Ser. No. 09/003,095, filed on Jan. 6, 1998, entitled"A Host Apparatus For Simulating Two Way Connectivity For One Way DataStreams", which is a continuation-in-part application to U.S. patentapplication Ser. No. 08/490,822, filed on Jun. 15, 1995, now U.S. Pat.No. 5,818,441, entitled System And Method For Simulating Two WayConnectivity For One Way Data Streams.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to enhancing one-way broadcast datatransmissions. More particularly, it relates to enhancing the qualityand content of a primary information stream by creating and transmittingassociated data which provides the appearance of an interactiveconnection to secondary sources of information.

2. Background

One of the limitations of nearly all forms of electronic mass media suchas radio, television, audio CD's and video cassettes is that thecommunication of information or data is one-way from provider to theconsumer. The characteristics of one-way sources of data are that thedata is sent sequentially and is fleeing or at best can be recorded forlater playback. And a consumer cannot interact with the data provided toseek additional information or services.

There is a desire by electronic mass media consumers for additionalservices, and providers of television and radio broadcast services arelooking for new sources of revenue. In particular, consumers are lookingfor information or data that is related to what they are viewing in themedia. The additional information may be in the form of details on thecontent of the current program such as the recipe of a meal beingdemonstrated on a cooking show or biographies of actors in a drama orhistorical background information on events depicted in a program. Or,it could be program highlights such as key plays from the baseball game.In addition, consumers would like access to real time data such as stockprice, updated baseball scores as they occur, traffic and weatherconditions. Also, consumers would like to have access to specialservices associated with product advertising such as information onwhere to buy nationally advertised products--possible with a map to thenearest location, or the ability to instantly receive coupons.

Recently, on-line services such as provided by the World Wide Web of theInternet have become available. Such services provide access to immenseamounts of data on an interactive basis by linking digital computerstogether over sophisticated communications networks. At the same time,the cost of digital computing power is falling rapidly. For example,many homes now have one or more computers. And home computers havedisplays capable of showing television as well as audio capability. Theyalso have memory and computing power.

But while such services are generally available and computers arebecoming more widespread, finding relevant information is an arduoustask that may take hours of searching even for an experienced user.

In addition, these services require a 2-way connection from a consumer'slocation to the on-line network. In the consumer market, prolongedutilization of a single phone line for 2-way digital communications isexpensive.

Up until now, there has been no way for producers of mass marketbroadcast programming to deliver data associated by its relevancy to itssubject matter that could be interactively displayed and manipulated byconsumers on a real time basis. What is meant by real time is that theconsumer receives and has access to the relevant data during the processof program reception. Therefore the data becomes an integral part of theexperience desired by the program producers.

Although received during a program, the information is retained and maybe traversed by the consumer at a later time, as if they were connectedin a 2-way fashion to an on-line service.

3. Prior Art

Perhaps the earliest effort to address the foregoing needs is forprogram content providers to include a telephone number in either theradio of television broadcast. The consumer is invited to dial a numberfor additional information. However, this telephone number is part ofthe primary data stream which is transitory.

A second attempt is the provision of closed caption programming for thehearing impaired on television. This takes the form of written textappearing somewhere on the television screen typically at the bottom andrequires a special decoder on the television. The text is a writtenrendition of the audio portion of the television program. That is, it isa recapitulation of the information supplied by the primary dataprovider and is not stored or saved for later access by the consumer.

Television networks also use a part of the unused bandwidth in the videosignal to send the schedule of programs coming up on that network. Onenetwork is sending a comprehensive program listing in digital formatover an unused section of the NTSC bandwidth. This is called anelectronic program guide ("EPG"). A second network uses a portion of theunused NTSC bandwidth to send digitally encoded stock quotes and thesubject matter of the topics covered in the news broadcast, and extendeddata services ("XDS") sends the date, time, name of a scheduled program,type of program and how much of the program remains. Cable servicesprovide additional detail about songs being played on subscriber digitalaudio services such as digital music express ("DMX(tm)"); The detailtypically consists of the name of the artist, the name of the song andthe album. A system called Gemstar(tm), provides information in digitalformat that enables consumers to record programs by referencing a numberin a program guide.

Many of the foregoing services are provided on broadcast television onlyover what is called the vertical blanking interval (the "VBI"). The VBIis a portion of the bandwidth defined for broadcast television and inthe case of NTSC, for example, consists of the first 21 of the 525raster lines that define a video frame. SECAM and PAL have a similararrangement. Of the 21 lines, line 21 is divided into two frames of 60hz bandwidth each. The closed caption is provided in the first frame ofline 21.

None of the foregoing allow a consumer to experience apparentinteractively with external data sources. That is, none provides datathat persists for more than a few seconds and none allows the consumerto manipulate directly that data.

SUMMARY OF THE INVENTION

A host device is disclosed. The host device includes a processor and acontrol mechanism. The processor operates to receive primary andassociated data, the associated data being targeted for differentrecipients. The processor further operates to decode and separate theassociated data from the primary data, and cause the associated data tobe correspondingly rendered on separate hand held devices. The processoralso operates the control mechanism to control a separate displayapparatus to separately receive and render the primary data.

BRIEF DESCRIPTION OF THE DRAWINGS

The preferred embodiments of the invention will now be described inconnection with the drawing wherein:

FIG. 1 is a block diagram of the invention at the highest level ofabstraction.

FIG. 2 is a block diagram showing one embodiment of the data streamscreation and delivery aspects of a system according to the presentinvention.

FIG. 3 is a block diagram showing the basic and optional elements forforming various embodiments of the data stream consumption aspect of thesystem.

FIG. 4 is a block diagram showing a functional view of the variousembodiments of the data stream consumption aspect of the system.

FIGS. 5a-5d are block diagrams illustrating various exemplaryembodiments of the data stream consumption aspect of the system.

FIG. 6 is a block diagram illustrating alternate basic and optionalelements for forming various embodiments for the consumption aspect ofthe system.

FIG. 7 is a block diagram illustrating one embodiment of the hand heldassociated data display and request input device of the presentinvention.

FIG. 8 is a block diagram showing a functional view of the variousembodiments of the data streams consumption aspect of the system.

FIGS. 9a-9d, 10a-10b, and 11a-11b are block diagrams illustratingvarious alternate exemplary embodiments of the data stream consumptionaspect of the system.

FIG. 12 is a block diagram illustrating one embodiment of theoperational flow of associated data protocol manager for splitting theassociated data.

FIG. 13 s a block diagram illustrating one embodiment of the operationalflow of graphical display interface for rendering split associated data.

DETAILED DESCRIPTION OF THE INVENTION

An electronic mass media provider may be said to deliver a one-waystream of electronic data. This stream of data is herein referred to asa primary stream of data and includes live or pre-recorded informationthat is created by the broadcasting and entertainment industries for thepurpose of delivery to consumers over delivery mediums such as broadcasttelevision, video cassettes, radio and audio CD's. The content of theprimary data streams typically created by production studios for massdistribution to the consumer market. Often a distributor produces all orpart of the programming content. For example, a local television newsstation obtains pre-produced video news and advertising content fromnational providers and inserts locally produced content and advertisingfor broadcast. Equipment used in the television industry are videocameras and video recorders. Typically, the primary data is organizedinto programs. A primary stream of data can be rendered intelligent to aconsumer as either audio or video or a combination of the two.

The term associated data as used herein refers to a stream of datagenerated separately from the primary data but having content that isrelevant to the primary data in general and usually relevant to aparticular program of primary data and is in this sense associated.Associated data is intended to enhance the utility of the primary datastream, but if it is not available, the primary data stream can stand onits own merits. The creation process typically uses commerciallyavailable software and hardware that output industry standard fileformats such as Hypertext Markup Language (HTML) for text and graphiclayout, Graphics Interchange Format (GIF) Joint Photographic ExpertGroup (JPEG) formats for still images, and so forth.

FIG. 1 is a block diagram of the invention at the highest level ofabstraction. Referring now to FIG. 1, data stream creation unit Iperforms the function of generating both the primary data stream and theassociated data stream. The two data streams may or may not be merged tocreate a combined stream of primary and associated data. The two datastreams are supplied to non-interactive delivery unit 2 which performsthe function of delivering the two data streams to the consumer. Thenon-interactive delivery unit includes delivery by broadcast, cable or apackaged media such a as cassettes and audio CD's. Indeed,non-interactive delivery is intended to include all one-way electronicdata delivery systems. The primary data stream and secondary data streamare typically transmitted to a consumer over the same delivery medium;however, the invention contemplates situations where this is not thecase. For example, the primary data stream could be delivered bybroadcast television and the associated data could be delivered over ahigh speed digital network, a FM sideband, a direct satellite broadcast,a cable network, a telephone, etc.

When the delivered data reaches consumer 3, it is decoded from itsdelivery medium. That is, if it is sent by broadcast television, theconsumer decodes the signal, separates the primary data from theassociated data, and stores the associated data for future use. Theprimary data is consumed with or without the associated data. However,when consumed with the associated data, the consumer may selectivelyinteract with the associated data, simulating a two-way connectivity forthe one way data streams.

FIG. 2 provides additional system detail for one embodiment of thepresent invention. Referring now to FIG. 2, reference numeral 10 refersto the primary data stream generation sub-system. The output of primarydata stream generation sub-system 10 is typically an analog signal.However, it may be a digital signal as in the case of digital broadcasttelevision. Data channel 12 connects primary data stream generationsub-system 10 and sequencer 14 and data channel 19 connects it to datasynchronizer 20. Data channels 12 and 19 may be initiated by a livevideo feed, or analog or digital tape. Reference numeral 16 refers to anassociated data generation sub-system. The output of associated datageneration sub-module 16 is a digital signal that is supplied overdigital data link 18 to sequencer 14 and over digital data link 17 tosynchronizer 20. In one embodiment, the associated data are targeted fordifferent recipients, and having the target recipients identificationembedded therein. In one embodiment, targeted recipients include a"public" recipient. Associated data targeted for the "public" recipientmay be received and rendered by all recipients. The digital data linksof the system may be a conventional digital connection such as a serialor parallel or it may be a network link. Typical connecting media wouldbe twisted pair, co-axial cable, fiber optic cable or a wireless media.

Reference numeral 20 refers to a data synchronizing sub-system whosefunction is to synchronize the primary data stream generated bysub-system 10 with specific associated data targeted for one or morerecipients. The input to data synchronizing sub-system 20 is sceneinformation from the primary data stream in the form of time codes andtime duration's, and data from associated data generator sub-system 16.It creates a so called script for the delivery and display of associateddata at specific points in time. For example, data synchronizer 20creates a script that specifies that a detailed data sheet will bedelivered to the consumer prior to a specific television productadvertisement, and that the data sheet will be displayed on theconsumer's display when a certain television advertisement starts. Asanother example, data synchronizer 20 creates a script that specifiesthat two different sets of game information are to be delivered to twogame players prior to the display of a series of game scenes, and thatthe different game information are to be correspondingly displayed onthe two game players' displays when a particular point of the game stageis reached.

Data synchronizer 20 typically includes software which is patternedafter common digital video editors such as Adobe's Premiere, whichplaces parallel video and audio tracks on a standard time line such asSMPTE (Society of Motion Picture and Television Engineers) time code.This allows segments of each track to be manipulated independently butwith reference to a common time line so that segments may later bereconstituted. The software of data synchronizer 20 allows associateddata to be laid out and manipulated on an additional data track. Thesize of particular associated data components is coordinated with theknown bandwidth of the delivery medium. The user of data synchronizer 20typically specifies that a unit of information should be displayed at aspecific point in time. Data synchronizer 20 then calculates the timerequired to transfer the data and inserts a transfer specification intothe script at the appropriate point prior to the display instruction.The output of data synchronizer sub-system 20 is a digital signalrepresenting a script that synchronizes the output of primary datastream sub-system 10 and associated data stream generator 16.

The output of the data synchronizer 20 is supplied over digital datalink 22 to sequencer sub-system 14. Digital data link 22 is aconventional digital link. Sequencer 14 combines the primary data streamwith the associated data as specified by the script supplied bysynchronizer sub-system 20. Sequencer 14 monitors the output fromprimary data stream sub-system 10 to obtain the information necessary tosequence transmission of associated data. For example, during thebroadcast of a television program, data sequence 14 obtains a time codeinformation such as SMPTE time code which is generated by the primarydata stream. The information is used to coordinate mixing of associateddata with primary data systems. In addition, sequencer 14 mixes otherdata feeds that are being transmitted over the same delivery medium.These may include external data services such as financial data,emergency broadcast information or weather information. Mixing ofexisting data streams is necessary only for delivery mediums that don'tsupport separate, independent transmission of digital information. Thisfunction has the capacity to be used for the delivery of either live orpre-recorded programming, or a combination of both. For liveprogramming, such as a local evening news program, the data streamsequencer takes input directly from the outputs of primary data streamgenerator 10, data synchronizer 20, associated data generator 16, andtime code form the primary data stream. For pre-recorded programming,this function processes the output of the data synchronizer 20 andsequences the broadcast of associated data with the primary data.

The output of sequencer 14 is supplied over conventional digital datalink 24 to encoder 26. Encoder 26 is a hardware component for insertionof digital information into the particular delivery medium that will bereceived by the consumer. If the delivery medium is broadcasttelevision, encoder 26 inserts this information directly into the NTSCtelevision signal, and this delivers both the primary and associateddata over a single delivery medium, broadcast television radio waves.Encoder 26 accepts input streams of both video and serialized digitalinformation. It breaks the serialized digital information up into aseries of packets, and modulates the packets into the ("VBI") of thevideo signal. Encoder 26 is commercially available hardware andsoftware. A number of vendors market hardware for insertion andextraction of data into and from standard (NTSC/PAL) television signals.Norpak Corporation, EEG, Inc., and WavePhore, Inc. are examples.

The output of encoder 26 is supplied via digital data link 28 totransmitter sub-system 30 which performs the function of physicallytransmitting radio frequency waves into the atmosphere. Suchtransmitters may be television or radio broadcast transmitters or asatellite broadcast system. Also, the data may be stored on a tape forlater transmission. Reference numeral 32 refers to the delivery mediawhich may be radio frequency electromagnetic waves passing through theatmosphere, a video tape, a laser disk, an audio CD and the like. Forthe later media, transmitter 30 becomes a video tape recorder, video oraudio CD recorder respectively.

FIG. 3 illustrates the basic and some optional elements for formingvarious embodiments of the data streams consumption aspect of thesystem. Reference numeral 34 generally indicates these basic andoptional equipment present at the consumer's location. Receiver 36 isused to receive the data streams. Receiver 36 may be an add-in adapterboard, a television or radio broadcast receiver, a cable televisionconverter or a satellite receiver for digital broadcast. Connected toreceiver 36 is a microprocessor 38 for processing the received datastreams. Connected to microprocessor 38 is memory 40 which is used astemporary storage by microprocessor 38. Memory 40 is typicallysemiconductor RAM. Also connected to microprocessor 38 are humaninterface devices for rendering the primary and associated data, as wellas inputting associated data requests. Human interface devices includeinput device 41 and display device 42. Additionally, optionalnon-volatile storage media 39 such as a hard disk may be provided forcaching received associated data, as well as two way communicationinterface 46 for accessing remote servers may be included in forming thevarious embodiments of the data streams consumption aspect of thesystem. Two way communication interface 46 may be an interface thataccesses the remote server over such media as the analog telephonenetwork, the ISDN digital network, a wide area packet switched networksuch as X25, frame relay or asynchronous transfer mode.

Recall that the delivery media may be radio frequency electromagneticwaves passing through the atmosphere, a video tape, a laser disk, anaudio CD and the like. For the later media, receiver 36 becomes a VCR,laser disk player or an audio CD player respectively.

FIG. 4 is a high level block diagram showing a functional view of thevarious embodiments of system 34 formed with the basic and optionalelements of FIG. 2. Referring now to FIG. 4, receiver 36 receives theprimary and associated data streams from the delivery media, e.g. radiofrequency waves, from input 50. Receiver 36 demodulates the input signaland supplies the primary data stream signal over data path 52 to primarydata rendering sub-system 54 and the associated data signal over datapath 56 to associated data decoder 58.

Primary data rendering sub-system 54 performs the function of presentingthe primary data stream to the consumer in the manner in which a typicalconsumer would expect to see the data presented. For example, in thecase of television, the primary data rendering takes the form of a videoimage typically supplied by a cathode ray tube screen, or possibly aliquid crystal display screen and audio provided by an audio amplifierand speakers. A second example is a broadcast radio demodulator,amplifier and speakers that renders radio waves received via radiobroadcasting audible to a consumer. Yet a third example is a stereosystem that renders data encoded on compact disk or tape audible to theconsumer.

Decoder 58 performs the function of decoding the associated data fromthe delivery media. In one embodiment, decoder 58 consists of an analogto digital converter that converts analog encoded digital data back todigital format.

Associated data protocol manager 60 is connected by one-way data path 62to decode 58 and by one-way data path 64 to communications manager 66.Associated data protocol manager 60 performs the function of extractingthe different forms of associated data from the incoming digital datastream and converting them to a form that can be used by communicationsmanager 66. For this embodiment, associated data protocol manager 60 iseither not cognizant of target recipient information, and thereforeextracts and converts all associated data, or associated data protocolmanager 60 is responsive to associated data that are targeted for"public" only, and therefore extracts and converts only so targetedassociated data. The types of associated data protocols include WorldWide Web pages, closed captioning, stock quotes, sports scores, controlcommands for microprocessor 38 (of FIG. 3) to execute.

Communications manager 66 performs the function of a common networkinterface by receiving data from several different types ofcommunication devices using different data transmission protocols. Suchdevices include telephone modems, ISDN modems, cable modems, wirelessmodems, satellite modems, a broadcast TV, radio and the like.Communication manager 66 converts all data received, regardless of thesource and protocol, into a standard format that can then be utilized bythe rest of the system. This function may be implemented in at least oneof two ways. Proprietary interfaces between the communication componentsmay be designed, or standard industry interfaces such as MicrosoftWindows (a trademark of Microsoft Corporation) sockets may be used. Inone embodiment, Windows sockets are used. A Windows socket is a standardapplication interface to access network data.

Real time trigger 76 is connected to communications manager 66 byone-way data path 78 and to associated data request input driver 88a bydata path 87. Associated data request input driver 88a provides theconsumer with the ability to input associated data requests to thesystem. In one embodiment, associated data request input driver 88ainterfaces to a keyboard and alternate input devices such as a mouse tofacilitate associated data request inputs from a user.

Real time trigger 76 accepts commands sent as part of the associateddata to display a page of information without the user asking for it.The output of real time trigger is a command sent over data path 87 toassociated data request input driver 88a which causes the page ofinformation to be displayed. For example, a broadcaster may want viewersto see a certain page of information as part of a program that is beingviewed. Real time trigger allows data to be displayed using the samedata protocols as consumer requested information.

Local data storage 80 is connected to communications manager 66 byone-way data path 82 and by data path 83 to local data manager 84. Thehardware implementation for local data storage 80 may be one or more ofthe following; RAM, disk, tape, recordable CD-ROM.

Local data manger 84 is connected to communications manager 66 by datapath 86 and to associated data request input driver 88a and associateddata rendering driver 88b by data paths 90 and 94. Local data manager 84receives commands from associated data request input driver 88a toretrieve associated data from local data storage 80 and sends that datato associated data rendering driver 88b for presentation to theconsumer. For example, a "Web Browser" may be used to display data pagesfrom the World Wide Web (the "WWW"). Providers of WWW browsers includeNetscape Communications Corp., America Online, Spyglass and others.Local data storage 80 will typically be of limited capacity. Thus, localdata manager 84 purges older and less used information. This isaccomplished by assigning an expiration date and/or a priority toassociated data files. The criteria for determining which data to purgeis settable by the broadcaster and/or the consumer. Criteria includetotal amount of storage available, size of associated data files,expiration date and priority.

Remote data manager 92 (which is included in embodiments provided withthe optional ability to access remote servers) is connected to localdata manager 84, associated data rendering driver 88b, andcommunications manager 66 by data paths 91, 94 and 96 respectively.Remote data manager 92 receives commands from local data manger 84 toobtain data from remote computers through two-way communications channel74 and send that data to associated data rendering driver 88b forpresentation to the consumer. Local data manager 84 provides thecommands to remote data manager 92 when it receives requests forassociated data that are not cached in the local storage.

Network protocol manager 68 (which is included in embodiments providedwith the optional ability to access remote servers) is connected to bytwo-way data path 70 to communications manager 66 and by two-way datapath 72 to two-way communication channel 74. Network protocol manager 68performs the function of formatting data received and transmitted overtwo-way communication channel 74. It contains the various protocolsrequired to communicate with remote computers. Again, operating systemssuch as Microsoft's Windows typically provide network protocol managerswith plug in modules called drivers to support different protocols anddifferent communication hardware. Network protocol manager 68 extractsincoming data from two-way communication channel 74 using a networkprotocol appropriate for the medium supported by two-way communicationchannel 74. Network protocol manager 68 also encodes output data usingthe appropriate protocol and passes the data onto two-way communicationchannel 74 for transmission to third party computers.

Two-way communications channel sub-system 74 provides the function forconnecting the client system interactively to remote computers that maybe server machines, machines at online service providers, the Internetor independent Bulletin Board Systems ("BBS"). The network to whichtwo-way communication channel 74 is connected may be a conventionalswitched analog telephone system interfaced to a modem, a digitalswitched system such as ISDN interfaced to an appropriate adapter card,a wide area network connected through an access device, satellitetechnologies, and the like. A two-way communications line is used toretrieve and access information that has only thus far been received bythe client system in the form of references, which are pointers to wherethe information actually resides.

The embodiment illustrated in FIGS. 2-4 operates in the followingmanner. A primary data stream is generated. Associated data isseparately generated. A script is generated that synchronizes how theprimary and associated data are linked together. The primary data, thesingle/multi-party associated data and the script are sent to sequencer14 where they are combined. The primary data is transmitted in theconventional fashion of its delivery medium. In the television model,this is broadcast over the air or on cable. The associated data isgenerally (but not always) sent by the same delivery medium as theprimary data. In the case of television, the associated data is encodedin the VBI of the television signal. The signal is received by theconsumer's equipment. The primary data stream is immediately renderedand the single/multi-party associated data is stored in local datastorage 80. At any time, the consumer may browse the data stored inlocal data storage. This data will have been professionally selected toprovide an enhanced viewing experience. For example, a difficult to finddata sources providing historical background to a program will have beenpreviously researched by the associated data provider and sent asassociated data. The human interface is user friendly and will allow theconsumer to browse through the entire or a designated subset of theassociated data. This might start with a menu of available informationfrom which the consumer could select just as if the data were comingfrom an online service. But the data is actually stored locally. And itarrived in local storage by being transmitted with the primary datastream. The consumer may process the associated data in a variety ofways including sorting and indexing relevant information.

The addition of a two-way communication channel allows a consumer toalso access online services. In such an embodiment, associated data mayconsist of references such as uniform resource locations ("URL") whichare WWW page references. Associated data may include references toInternet News Groups which are shared static messages grouped by topicwhich may be accessed. Associated data may also include references toInternet Relay Chat areas which are multi-person dynamic conversationstreams that enable users to communicate by text messages. Or,associated data may include pointers to information on an online servicesuch as America Online, Prodigy or Compuserve. Thus, a menu may listseveral references. And by clicking on a reference, the system actuallyconnects to and retrieves the referenced information from theappropriate source.

Alternatively, the associated data may itself include not only pointersto information on various online services, but the actual informationwhich the associated data provider has acquired from an online serviceor source and incorporated into the associated data prior to itsdelivery to the consumer. For example, the associated data may containactual Internet News Group messages related to the primary data stream.Thus, even if the consumer does not have a two-way communicationschannel or chooses not to use it, the invention provides the appearanceand feel of an interactive connection to remote sources of relevantinformation.

FIGS. 5a-5d illustrate various exemplary embodiments of the data streamsconsumption aspect of the system that can be formed with the basic andoptional elements of FIG. 3. For the exemplary embodiment illustrated inFIG. 5a, receiver 36, microprocessor 38 and memory 40 are combined toform exemplary computer 35. Exemplary computer 35 is also provided withoptional non-volatile storage 39 as well as two way communicationinterface 46. Computer 35 receives the primary and associated datastreams, decodes and separates the data streams, and renders the primarydata with or without the associated data using display 42, as requestedby the user. For the illustrated embodiment, all associated data,regardless of the targeted recipients are rendered. In an alternateembodiment, computer 35 may render "public" associated data only. Userinput device 43 is used to provide the associated data request inputs toexemplary computer 35. Exemplary computer 35 is intended to represent abroad category of general as well as special purpose computers known inthe art. Display 42 is typically a monitor, whereas user input device 43is a keyboard with or without a complementary cursor control device.

FIG. 5b illustrates an alternate embodiment. The difference between theembodiments illustrated in FIG. 5a and 5b is the fact that exemplarycomputer 35 is formed without receiver 36, and television 42 withreceiver 36 is used as a display for the primary and associated datainstead. For this embodiment, exemplary computer 35 receives the primaryand associated data streams through receiver 36 of TV 42. Exemplarycomputer 35 decodes and separates the primary and associated datastreams, and renders the primary data with or without the associateddata, as described earlier. Similarly, for the illustrated embodiment,all associated data, regardless of the targeted recipients are rendered.However, in an alternate embodiment, computer 35 may render "public"associated data only.

FIG. 5c illustrates yet another alternate embodiment. In FIG. 5c, TVtuner 36, microprocessor 38, memory 40 and CRT 42 are used to formexemplary set top box 35. For the illustrated embodiment, set top box 35is complemented with optional external storage device 39. While notshown, set top box 35 may also be provided with optional two waycommunication interface 46. Similar to the earlier embodiments,exemplary set top box 35 receives the primary and associated datastreams, decodes and separates the data streams, and renders the primarydata with or without the associated data using TV 42, as requested bythe user. User input device 43 is used to provide the associated datarequest inputs to exemplary set top box 35. For the illustratedembodiment, all associated data, regardless of the targeted recipientsare rendered, while in another embodiment, set top box 35 may renderonly "public" associated data.

FIG. 5d illustrates yet another alternate embodiment. In FIG. 5d,receiver 36, microprocessor 38 and memory 40 are used to form exemplaryPC/TV 35 (i.e. a TV with integrated digital computing capability). Forthe illustrated embodiment, exemplary PC/TV 35 is also provided withoptional non-volatile storage device 39 and two way communicationinterface 46. Similar to the earlier embodiments, exemplary PC/TV 35receives the primary and associated data streams, decodes and separatesthe data streams, and renders the primary data with or without theassociated data using CRT 42, as requested by the user. User inputdevice 43 is used to provide the associated data request inputs toexemplary PC/TV 35. Similarly, for the illustrated embodiment, allassociated data, regardless of the targeted recipients are rendered,while in another embodiment, PC/TV 35 may render only "public"associated data.

FIG. 6 illustrates an alternate collection of basic and optionalelements for forming the various embodiments of the data streamsconsumption aspect of the system. The difference between the elementsillustrated in FIG. 6 and the elements illustrated in FIG. 3 is the factthat at least two separate display devices, 42 and 200, are employed torender the primary and the associated data. As will be described in moredetail below, for many embodiments, two or more associated data displaydevices 200 are employed. Preferably, each associated data displaydevice 200 is an integrated hand held associated display and requestinput interface device. In other words, each associated data interfacedevice 200 is a display as well as an input device, having a relativelysmall form factor suitable for hand held operation. In one embodiment,each integrated hand held associated data interface device 200 is awireless device. In other words, each integrated hand held associateddata interface device 200 communicates with processor 38 through thewireless medium, Additionally, by virtue of the employment of separatedisplay device(s) 200 to render the associated data, primary datadisplay device 42 may be "loosely coupled" to processor 38 or evendecoupled from processor 38.

FIG. 7 illustrates an exemplary embodiment of the integrated associateddata display and request input interface device. As shown, integratedassociated data display and request input interface device 200 includescommunication interface 202, microprocessor 204, memory 206 and displayelement 208, coupled to each other as shown. These elements are packagedwith enclosure 212 having physical dimensions consistent with hand helddevices known in the art, to allow a user to comfortably operate thedevice while holding the device in his/her hands. For the illustratedembodiment, exemplary integrated associated data display and requestinput interface device 200 is also provided with stylus input 210 toallow a user to interact with a graphical end-user interface to provideassociated data request inputs. Furthermore, communication interface 202is a wireless transmitter/receiver, whereas display element 208 is aflat panel display. Elements 202-210 are intended to represent a broadcategory of these elements known in the art. In particular,microprocessor 204 are intended to represent 8-bit microcontrollers,16-bit DSP processors, as well as 32-bits or greater general purposemicroprocessors.

FIG. 8 illustrates an alternate functional view of data streamconsumption aspect of the system, when a separate display device havingits own processor is employed to render the associated data. FIG. 8differs from FIG. 4 in that associated data protocol manager 60 isfurther equipped to be able to comprehend the target recipientinformation, i.e. being able to recognize different portions of theassociated data are targeted for different recipients, and who therecipients are. With this ability, associated data protocol manager 60further splits the associated data for the corresponding targetedrecipients, before it correspondingly extracts and converts theassociated data as described earlier. Furthermore, local data manager 84and remote data manager 92 invoke graphical display interface 106 tocorrespondingly render the associated data. Instead of rendering theassociated data on a physically coupled display device, graphicaldisplay interface 106 correspondingly provides the graphical renderingcommands to communication manager 66, which in turn correspondinglytransmits them, over the wireless medium, to communication manager 222of the integrated hand held associated data display and request inputinterface devices 200.

Over in each of the integrated associated display and request inputinterface devices 200, communication manager 222 receives and forwardsthe graphical rendering commands to graphical display interface 224,which in turns executes the commands, causing the (separately targeted)associated data to be correspondingly rendered on the appropriateassociated data interface device 200.

Additionally, data request input driver 226 forwards any associated datarequest inputs it receives from the user to communication manager 222for transmission, over the wireless medium, to "host" communicationmanager 66. Over in the "host" system, communication manager 66 receivesand forwards the associated data request inputs to local data manager 84through input request driver 104. Local data manager 84 in turnsprocesses the received associated data request inputs as describedearlier.

Skipping now to FIG. 12, wherein a block diagram illustrating oneembodiment of the operational flow of associated data protocol manager60 for splitting the associated data is shown. As illustrated, uponreceipt of the associated data from decoder 58, associated data protocolmanager 60 looks for the first recipient identification (party-id), step402. Upon locating the first recipient identification, associated dataprotocol manager 60 buffers/queues the associated data for the firstrecipient in a buffer/queue allocated to the first recipient, step 404.Protocol manager 60 performs step 404 until either a new recipientidentification or an end of data (EOD) indicator is encountered. If anew recipient identification is encountered, protocol manager 60switches the buffering/queuing to a different buffer/queue allocated tothe next recipient, step 408, and repeats step 404, else (i.e. whenencountering an EOD indicator) protocol manager 60 terminates thesplitting process.

Referring now to FIG. 13, wherein a block diagram illustrating oneembodiment of the operational flow of local data manager 84 for causingthe split associated data to be correspondingly rendered is shown. Asshown, for the illustrated embodiment, local data manager 84 traversesbuffers/queues 412 of the different recipients, and invoking thegraphical display interface to correspondingly render thebuffered/queued split associated data of the different recipients, in a"round robin" fashion. As described earlier, graphical display interfaceprovides the rendering commands to communication manager 66, which inturn transmits them to the hand held devices 200. In one embodiment,graphical display interface identifies the recipient associated with thebuffer/queue 412 from which it retrieves the split associated data forcommunication manager 66. In turn, communication manager 66 transmitsthe split associated data to the targeted recipient. Various analog anddigital techniques are known in the art for a transmitter to transmitdata to a particular one of a number of potential recipients in thewireless spectrum. Any one of these techniques may be employed. Theillustrated "round robin" manner has the advantage of balancing thetransfer of the split associated data to the different recipients.However, other manners of transferring the split associated data,including a serial fashion, may be employed instead.

Referring now to FIGS. 9a-9d, wherein four block diagrams illustratingvarious exemplary embodiments of the data streams consumption aspect ofthe system that can be formed with the basic and optional elements ofFIG. 6 are shown. The exemplary embodiments are similar to those of FIG.5a-5d, except for the employment of the integrated wireless hand heldassociated data interface devices 200, and the provision of wirelesstransmitter/receiver 102 to the computer, set top box or PC/TV, tofacilitate wireless communication between the "host" system and thewireless hand held associated data interface.

In FIG. 9a, receiver 36, microprocessor 38 etc., together with wirelesstransmitter/receiver 102, are employed to form exemplary computer 35.Exemplary computer 35 first receives the primary and the associateddata, then decodes and separates the associated data from the primarydata, as exemplary computer 35 of FIG. 5a. However unlike the earlierdescribed embodiment, exemplary computer 35 of FIG. 9a renders theprimary data on display 42, splits the associated data, andcorrespondingly transmits the commands for rendering the splitassociated data, through the wireless medium, to integrated wirelesshand held associated data interface devices 200, to cause the associateddata to be correspondingly rendered.

In FIG. 9b, microprocessor 38 etc., together with wirelesstransmitter/receiver 102, are employed to form exemplary computer 35.Exemplary computer 35 first receives the primary and the associated datausing receiver 36 of TV 42, then decodes and separates the associateddata from the primary data, as exemplary computer of FIG. 5b. Howeverunlike the earlier described embodiment, exemplary computer 35 rendersthe primary data on TV 42, but splits the associated data, andcorrespondingly transmits the commands for rendering the splitassociated data, through wireless medium, to integrated wireless handheld associated data interface devices 200, to cause the associated datato be correspondingly rendered.

In FIG. 9c, receiver 36, microprocessor 38 etc., together with wirelesstransmitter/receiver 102, are employed to form exemplary set top box 35.Exemplary set top box 35 first receives the primary and the associateddata using receiver 36 of TV 42, then decodes and separates theassociated data from the primary data, as set top box 35 of FIG. 5c.However unlike the earlier described embodiment, exemplary computer 35renders the primary data on TV 42, but splits the associated data, andcorrespondingly transmits the commands for rendering the associateddata, through the wireless medium, to integrated wireless hand heldassociated data interface devices 200, to cause the associated data tobe correspondingly rendered.

In FIG. 9d, TV tuner 36, microprocessor 38 etc., together with wirelesstransmitter/receiver 102, are employed to form exemplary PC/TV 35.Exemplary PC/TV 35 first receives the primary and the associated data,then decodes and separates the associated data from the primary data, asPC/TV 35 of FIG. 5d. However unlike the earlier described embodiment,exemplary PC/TV 35 renders the primary data on CRT 42, but splits theassociated data, and correspondingly transmits the commands forrendering the associated data, through the wireless medium, tointegrated wireless hand held associated data interface 200, to causethe associated data to be correspondingly rendered.

In each of these embodiments, a user may selectively interact andconsume the associated data holding one of the integrated wireless handheld associated data interface devices 200, while consuming the primarydata rendered on a physically decoupled monitor or TV. Therefore, eachof these embodiments advantageously enables a user to comfortablyconsume the primary and associated data, e.g. in a family room setting;an advantageous feature that is unavailable from the embodiments of FIG.5a-5d. Furthermore, the associated data consumed may be individualizedin whole or in part, thus allowing multiple hand held device 200 holdersto be able to have different associated data experience, and yet havingthe same primary data as well as public associate experience.

As alluded to earlier, with the employment of a separate display deviceto render the associated data, in particular, a wireless hand helddevice, the display device for rendering the primary data may be"loosely" coupled to the processor that processes the associated data.FIGS. 10a-10b illustrate two further alternate exemplary embodimentsthat can be formed using the alternate collection of elementsillustrated in FIG. 6. In FIG. 10a, TV 42 employed to render the primarydata includes IR receiver 106 for receiving remote control commandsprovided through the infrared spectrum, and exemplary computer 35 issimilarly constituted as exemplary computer 35 of FIG. 9a, as well asprovided with a compatible IR receiver 104. Thus, exemplary computer 35can track the remote control commands provided to TV 42, in particular,channel tuning commands, allowing exemplary computer 35 to control itsown receiver 36 to tune to the same channel to extract, and in turns toprovide the correct associated data, through the wireless medium, towireless hand held associated data interface devices 200,. Accordingly,TV 42 and exemplary computer 35 may be decoupled, further facilitatingcomfortable consumption of the primary and associated data in e.g. afamily room setting.

Likewise, in FIG. 10b, TV 42 employed to render the primary dataincludes IR receiver 106 for receiving remote control commands providedthrough the infrared spectrum, and exemplary set tip box 35 is similarlyconstituted as exemplary set top box 35 of FIG. 9c, as well as providedwith a compatible IR receiver 104. Thus, exemplary set top box 35 cantrack the remote control commands provided to TV 42, in particular,channel tuning commands, allowing exemplary set top box 35 to controlits own receiver 36 to tune to the same channel to extract, and in turnsto provide the correct associated data, through the wireless medium, towireless hand held associated data interface devices 200,. Accordingly,TV 42 and exemplary set top box 35 may be decoupled, furtherfacilitating comfortable consumption of the primary and associated datain e.g. a family room setting.

FIGS. 11a-11b illustrate two further alternate exemplary embodimentsthat can be formed using the alternate collection of elementsillustrated in FIG. 6. Exemplary computer and set top box 35 of FIG.11a-11b are similar to the embodiments of FIGS. 10a-10b respectively,except each of exemplary computer and set top box 35 of FIGS. 11a-11b isfurther provided with IR transmitter 108 to transmit remote controlcommands to control TV 42. Thus, instead of having to provide compatibleIR receivers 104 and 106 to both TV 42 and exemplary computer/set topbox 35, incompatible ones may be provided, as long as exemplarycomputer/set top box 35 is provided with the capability of transmittingremote control commands that are understandable to TV 42. Such abilitycan be provided for example by providing a universal remote controlcommands database to exemplary computer/set top box 35 of FIGS. 11a-11b.In other words, exemplary computer/set up box 35 of FIGS. 11a-11b may beadvantageously used with a number of existing TV to facilitatecomfortable consumption of the primary and associated data in e.g. afamily room setting.

The foregoing preferred embodiments are subject to numerous adaptationsand modifications without departing from the concept of the invention.Therefore, within the scope of the appended claims, the invention may bepracticed other than as specifically described herein.

What is claimed is:
 1. An apparatus comprising:(a) a processor toreceive primary and associated data, with the associated data beingtargeted for different recipients, to decode and separate the associateddata from the primary data, and to cause the associated data to beseparately rendered, with the associated data being correspondinglyrendered for the targeted recipients, the processor is also toseparately cause a separate display apparatus to separately receive andrender the primary data; and (b) a control mechanism coupled to theprocessor to facilitate the processor in causing said separate displayapparatus to separately receive and render the primary data; and (c) asplitter coupled to the processor to facilitate the processor insplitting the associated data for corresponding rendering, wherein thesplitter comprises a first plurality of instructions that facilitatetransmission of the split associated data to the corresponding targetedrecipients and a second plurality of instructions that facilitateincremental transmission of the split associated data to thecorresponding targeted recipients in a round robin fashion, whenexecuted by the processor.
 2. The apparatus as set forth in claim 1,wherein the splitter comprises a plurality of instructions that splitsthe associated data for corresponding rendering, when executed by theprocessor.
 3. The apparatus as set forth in claim 1, wherein theapparatus further comprises a plurality of buffers to correspondinglybuffer the split associated data.
 4. The apparatus as set forth in claim1, wherein the apparatus further comprises a plurality of queues tocorrespondingly queue the split associated data.
 5. The apparatus as setforth in claim 1, wherein the apparatus further comprises a selected oneof a wire and a wireless communication interface coupled to theprocessor to facilitate the processor in rendering the associated dataon corresponding hand held devices of the target recipients.
 6. Theapparatus as set forth in claim 5, wherein the selected one of a wireand wireless communication interface is a selected one of a wire and awireless transmitter/receiver that further facilitates the processor inreceiving associated data request inputs from the hand held devices. 7.The apparatus as set forth in claim 1, wherein the apparatus is aselected one of at least a computer and a set top box.
 8. A systemcomprising:(a) a host device to receive primary and associated data,with the associated data being targeted for different recipients, todecode and separate the associated data from the primary data, and tocause the associated data to be correspondingly rendered on hand helddevices of the targeted recipients, the host device is to furtherseparately cause a separate display apparatus to separately receive andrender the primary data; and (b) the hand held devices, communicativelycoupled to the host device, and responsive to render the associated dataresponsive to the host device, each of the hand held devices havingexternal physical dimensions that are suitable for hand held usage whileviewing the separately rendered primary data.
 9. The system as set forthin claim 8, wherein the host device comprises:(a.1) a processor toreceive the primary and the associated data, to decode and separate theassociated data from the primary data, and to cause the associated datato be correspondingly rendered on the hand held devices of the targetedrecipients; and (a.2) a control mechanism coupled to the processor tofacilitate the processor to control the separate display apparatus toseparately receive and render the primary data.
 10. The system as setforth in claim 9, wherein the host device further comprises a splittercoupled to the processor to facilitate the processor in splitting theassociated data for corresponding rendering.
 11. The system as set forthin claim 10, wherein the splitter comprises a first plurality ofinstructions that split the associated data for corresponding rendering,when executed by the processor of the host device.
 12. The system as setforth in claim 10, wherein the host device further comprises a secondplurality of instructions that facilitate transmission of the splitassociated data to the corresponding targeted recipients, when executedby the processor of the host device.
 13. The system as set forth inclaim 12, wherein the second plurality of instructions facilitateincremental transmission of the split associated data to thecorresponding targeted recipients in a round robin fashion.
 14. Thesystem as set forth in claim 10, wherein the host device furthercomprises a plurality of buffers to correspondingly buffer the splitassociated data.
 15. The system as set forth in claim 10, wherein thehost device further comprises a plurality of queues to correspondinglyqueue the split associated data.
 16. The system as set forth in claim 8,wherein the host device further comprises a selected one of a wire and awireless communication interface coupled to the processor to facilitatethe processor in rendering the associated data on corresponding ones ofthe hand held devices.
 17. The system as set forth in claim 16, whereinthe selected one of a wire and a wireless communication interface is aselected one of a wire and a wireless transmitter/receiver that furtherfacilitates the processor in receiving associated data request inputsfrom the hand held devices.
 18. The system as set forth in claim 8,wherein the control mechanism is an IR transmitter that operates by theprocessor to transmit IR remote control commands to the separate displayapparatus to cause the separate display apparatus to separately receiveand render the primary data.
 19. The system as set forth in claim 8,wherein the host device is a computer and the separate display apparatusis a television.
 20. The system as set forth in claim 8, wherein theapparatus is a set top box, and the separate display apparatus is atelevision.
 21. A method comprising:(a) receiving primary and associateddata, where the associated data are targeted for different recipients;(b) decoding and separating the associated data from the primary data,and causing the associated data to be separately renderedcorrespondingly for the targeted recipients, wherein the associated datais split for corresponding rendering and incrementally transmitted tothe corresponding targeted recipients in a round robin fashion; and (c)causing a separate display apparatus to separately receive and renderthe primary data.